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WHAT IS CLAIMED IS: 



1. 



A data processing device comprising: 



input means for 



inputting context description data 



described in a hierarchical structure, 



wherein the hierarchical structure comprises : 



the highest hierarchical layer in which time-varying 
media content and the context of the media content are formed into 
a single element representing media content; 



the lowest hierarchical/layer in which an element 
represents a media segment formed by dividing the media content 



and is assig 



as an 



a corresponding medi 

other hierarct 

\ 

directly or indirectly; 



15 segments and which re 



seiz 



attribute, time information relating to 
Jment and a score; and 

Layers include elements which are 
associated with at least one of the media 
resent scenes or a set of scenes; and 
selection mefenf\for selecting at least one segment from 
the media content, on th^ ba^s of^the score assigned to the context 
description data. 

2. The data processing device according to claim 1, 




\ 



further comprising extraction means for extracting only data 
corresponding to the segment selected by the selection means , from 
the media content. 



25 



The data processing device according to claim 1, 



10 



15 
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further comprising playback means for playing back only data 
corresponding to the segment selected by the selection means , from 
the media content • 

4. The data processing device according to claim 1, 
wherein the sore represents a contextual importance of media 
content . 



5 . The data 
wherein the scorarepre 
of a scene of inte 
selection means sel 
at least one viewpoint^. 




processing device according to claim 1, 
sents the degree of contextual importance 
from the viewpoint of a keyword, and the 



eije 




e in which the score is used from 



6. The data lprfoces"feing device according to claim 1, 
wherein the media content corresponds to video data or audio data. 



7. The data processing device according to claim 1, 
wherein the media content\ corresponds to data comprising video 
2 0 data and audio data, whicm are mutually synchronized. 



8. The data processing device according to claim 7 
wherein the context descriptior^data describe the configuration 
of video data or audio data. 



25 





9. 



The data 
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processing device according to claim 7 , 



wherein the context description data describe the configuration 



of each of video data si 



ets and audio data sets . 



10 



15 



20 



10. The data/ processing device according to claim 8, 
wherein the selection mpans selects a scene by reference to context 
description d^ta pert/aininq to video data or audio data. 



processing device according to claim 8, 
comprises video selection means for 
a^by reference to context description 
election means for selecting a scene 
to context description data of audio 




12. The data processing device according to claim 9, 



wherein the selection! means comprises video selection means for 
selecting a scene of video data by reference to context description 
data of video data, andlaudio selection means for selecting a scene 
of audio data by reference to context description data of audio 
data . 



13. The data processing device according to claim 2, 
wherein the data to be extracted by the extraction data correspond 
2 5 to video data or audio dats 
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14, The data processing device according to claim 2, 
wherein the data to be extracted by the extraction data correspond 
to data comprising video data and audio data, which are mutually 
synchronized. 



10 



15 



15. 1 The data processing device according to claim 1, 
wherein media content comprises a plurality of different media 



20 



data sets within a single period of time; and 

the data processing device further comprises: 
determination means which receives structure description 
data having N a^ta configuration of the media content described 
therein"a*Kl determines whi6h one of the media data sets is to be 
taken as an ot^iect of se£e&fc4pn, on the basis of determination 
conditions to bteNised for determining data as an object of 
selection; and 

the selection means^felects data from only the data sets, 
which have been determined as objects of selection by the 
determination mean^ , by reference to the structure description 
data . 



25 



16. The data\ processing device according to claim l f 
further comprising : 

determination meaKs which receives structure description 
data having a data configuration of the media content described 
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therein and determines whether only video data, only audio data, 
or both video data and audio data are taken as an object of 
selection, on the basis of determination conditions to be used 
for determining data as an object of selection; and wherein 

the selection means selects data from only the data sets 
determined as objects of selection by the determination means, 
by reference to the Istructure description data. 



17. The d^t^ processing device according to claim 16, 
10 wherein media content \c*ompr is es a plurality of different media 
data sets withi^a \a sirkjie ^e^ipd of time; 



|*y the deteAninaxlon means receives structure description 

data having a data Iguration of the media content described 

therein and determines which one of the video data sets and/or 
15 audio data sets is to b© taken as an object of selection; and 
the selection meanfe selects data from only the data sets 
determined as objects of Selection by the determination means, 
by reference to the structure description data. 

20 18. The data processing device according to claim 1, 

wherein representative data pertaining to a corresponding media 
segment are added, as an attribute, to individual elements of 
context description data in the lowest hierarchical layer; and 
the selection means selects the entire data pertaining 
25 to the media segment and/or representative data pertaining to a 



VIST 
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corresponding media segment, 



10 



15 



20 



. 19. The data processing device according to claim 18 , 
wherein the entire data /pertaining to the media segment correspond 
to media data, and the media content comprises a plurality of 
different media data /sets within a single period of time; and 

the data processing device further comprises 
determination means jwhich receives structure description data 
having a da\a configuration of the media content described therein 



and determifte§Nwhic 
representativ 
and 

the 

determined as objec 
by reference to the 




of the media data sets and/or 
is to be taken as an object of selection; 



means selects data from only the data sets 
s N q f selection by the determination means, 
str\*pture description data. 



25 



20. The dajjta processing device according to claim 1 8 , 
further comprising: 

determination means which receives structure description 
data having a data configuration of the media content described 
therein and determines whether only the entire data pertaining 
to the media segment, only the representative data pertaining to 
the media segment, or both the entire data and the representative 
data pertaining to a corresponding media segment are taken as 
objects of selection, oA the basis of determination conditions 



- 126 - 

to be used for determining data as &n object of selection; and 
wherein / 

the selection means selects data from only the data sets 
determined as objects of selection by the determination means , 



5 by reference to the structure description data. 



10 



20 



21 



The data processing device according to claim 15, 



wherein the determination c^aitions comprise at least one of the 
capability of g r^eivii>4 terminal, the traffic volume of a 



delivery line, 
thereof . 




es't , and a user ' s taste , or a combination 



22. ThQ^VdaMca processing device according to claim 2, 
further comprising folfm^tion means for forming a stream of media 

15 content from the datc^ /extracted by the extraction means 

23. The datta processing device according to claim 22, 
further comprising delivery means for delivering the stream 
formed by the formation means over a line* 



24 



The data processing device according to claim 22, 



further comprising 



formed by the formation means on a data recording medium. 



recording means for recording the stream 



25 



25. The data processing device according to claim 24, 
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further comprising data recording medium management means which 
re-organizes the media content that has already been stored and/or 
media content to be newly stored, according to the available disk 
space of the data recording medium. 



10 



15 



20 



25 



26. The data processing device according to claim 24 , 
further comprising stored content management means for re- 
organizing the mJdia content stored in the data recording medium 
according to the Iprgi^od of' storage of the media content. 



27. ^ A data processing method comprising the steps. of : 
inpul^ing ^context description data described in a 
hierarchical st^ucj/ure , 

wherein tnek Hierarchical structure comprises: 
the highest! hierarchical layer in which time-varying 
media content and thelcontext of the media content are formed into 
a single element representing media content; 

the lowest hierarchical layer in which an element 
represents a media segment formed by dividing the media content 
and is assigned, as anWttribute, time information relating to 
a corresponding media segment and a score; and 

other hierarchical layers include elements which are 
directly or indirectly associated with at least one of the media 
segments and which represent scenes or a set of scenes; and 

selecting at least one segment from the media content, 
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on the basis of the score assigned to the context description data. 

28. The\data processing method according to claim 27, 
further comprisingi an extraction step for extracting only data 
corresponding to th^ segment selected by the selection means , from 
the media content. 



10 



29. The data processing method according to claim 27, 
further comprising a \ playback ^tep for playing back only data 
corresponding to the s^gmef^t s^lect^ by th£ selection means , from 
the media content. 



30. The data ftr* 
wherein the sore repress 
15 content. 



>ce$feimg method according to claim 27, 
contextual importance of media 



20 



31. The data processing method according to claim 27, 
wherein the score represents che degree of contextual importance 
of a scene of interest from tttie viewpoint of a keyword, and in 
the selection step there is selected a scene in which the score 
is used from at least one viewpoint. 



32. The data processingVnethod according to claim 27, 
wherein the media content corresponds to video data or audio data. 



25 
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33. The data processing method according to claim 27 , 
wherein the media content corresponds to data comprising video 
data and audio data, ^hich are mutually synchronized. 



34. The dat'a processing method according to claim 32, 
wherein the context description data describe the configuration 
of video data or fcaudio data. 



35. \ The data pis^ce^sing method according to claim 33, 
10 wherein the context description data describe the configuration 
of each of videov data sets and\udio data sets. 



36. The da^ba/proces sing method according to claim 34, 
wherein, in the sJl^ct^ion step, a scene is selected by reference 



15 to context descripjtio 



a pertaining to video data or audio data . 



20 



37. The data processing method according to claim 34, 

wherein the selection step comprises a video selection step for 

i 

selecting a scene of video data by reference to context description 
data of video dataLr an audio selection step for selecting a scene 
of audio data by reference to context description data of audio 
data. 



38. The data processing method according to claim 35, 



.i 



25 wherein the selection means comprises a video selection step for 
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selecting a scene of video data by reference to context description 
data of vid^o data, and an audio selection step for selecting a 
scene of audio data by reference to context description data of 
audio data. 



39. ^The data processing metho,d^according to claim 28, 
wherein the data to be extracted in the extraction step correspond 
to video data lor audio data . 



40. T] 
wherein the dat; 
to data comprisii 
synchronized . 



^ta prpcessing method according to claim 28, 
:o be ex^as^icted in the extraction step correspond 
\g vijfeo data and~"aXrci^Lo data, which are mutually 



41. Tl^V^ata processing method according to any one of 
claims 27, whe^eiNpYpiedia content comprises a plurality of 
different med^a dat&Xsets within a single period of time; and the 
data processing method further comprises a determination step of 
receiving structure description data having a data configuration 
of the media content described therein and determining which one 
of the media data sets isv to be taken as an object of selection, 
on the basis of determination conditions to be used for determining 
data as an object of selection; and, in the selection step, data 
are selected from only the data sets, which have been determined 
as objects of selection by thAdetermination means, by reference 
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to the structure description data, 



42. The data processing method according to claim 27, 

further comprising: 

a determination for receiving structure description data 
having a data configuration of the media content described therein 



and determines whet) 
video data and aud 
on the basis of dete 
10 data as an object of 
in the select 1 
data sets determined a 
means, by reference to 



ip data are taken 



condit; 



er only video data, cyarly audio data, or both 

an object of selection, 
bns to be used for determining 
and wherein 

are selected from only the 
ts of selection by the determination 
structure description data. 



seled 



on ster 



ob j< 



ttte 



15 43. The dat^^p^ocessing device according to claim 42, 

wherein media content coifc&rises a plurality of different media 
data sets within a singl4 period of time; 

in the determination step, there are received structure 
description data having a data configuration of the media content 
20 described therein, and a determination is made as to which one 
of the video data sets and/oV audio data sets is to be taken as 
an object of selection; and 

in the selection meansV data are selected from only the 
data sets determined as objects df selection by the determination 
25 means, by reference to the structure description data. 
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44. The data processing method according to any one of 
claims 27 , wherein representative data pertaining to a 
corresponding media segment are added, as an attribute , to 
5 individual elements of context description data in the lowest 
hierarchical layer; and 

in the selection step, there are selected the entire data 
pertaining to the Wedia segment and/or representative data 
pertaining to a corresponding media segment. 



10 



15 



20 



45. The d 
wherein the enti 



processing 



data ptertaind 



me* 



to media data, and rthe _ 

\ \ / 

different media data Isets 
the data proj 



method according to claim 44, 
to the media segment correspond 
onterft\ comprises a plurality of 
thin a single period of time; and 
essdng method further comprises a 
determination step /fqjtel receiving structure description data 
having a data configuration of the media content described therein 
and determining which cEne of the media data sets and/or 
representative data sets\is to be taken as an object of selection; 
and 

in the selection Vneans, data are selected from only the 
data sets determined as objects of selection by the determination 
means, by reference to the structure description data. 



25 



46. The data processing method according to claim 44 



20 



# 




\ 
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further comprising: 



a determination step for receiving structure description 
data having aldata configuration of the media content described 
therein and determining whether only the entire data pertaining 



to be used for 



5 to the media segment, only the representative data pertaining to 
the media segmLnt, or both the entire data and the representative 
data pertainir.g to a corresponding media segment are taken as 
objects of selection, on the basis of determination conditions 

determining data as an object of selection; and 
10 wherein in the selection step, data are selected from only 

the data sets dej^rrtbined as obj^eTts of selection by the 
determinatio^npfeans , b^ refe^nce to the structure description 
data . 



15 




processing method e according to claim 4 1 , 
ioxi conditions comprise at least one of the 
ing terminal, the traffic volume of a 
request , and a user ' s taste , or a combination 



48. The data processing method according to claim 28, 



further comprising a formation step for forming a stream of media 
content from the data \extracted by the extraction means . 



25 



49. The data processing method according to claim 48, 
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further comprising a delivery step for delivering the stream 
formed by the ^formation means over a line. 



50, The data processing method according to claim 48, 



A 



5 further comprising a recording step for recording the stream 



formed by the formation means on a data recording medium. 



10 



15 



51. The data processing method according to claim 50, 
further comprising a data recording medium management step for 
re-organizing the mqdia content that has already been stored 
and/or media content tb be netfly Vtored< according to the available 
disk space of the datia recording/medium. 



52 . The data \proq 1 
further comprising a s 



lore 



organizing the media content 
according to the period ©f fe 




according to claim 50, 
agement step for re- 
in the data recording medium 
ge of the media content. 



53. A computer-readable recording medium on which the 
20 data processing method accoAling to claim 27 is recorded in the 
form of a program to be perjnprmed by a computer. 



25 



54 . A program for causdng a computer to perform the data 
processing method according to claim 27 . 




